Network resource monitoring and measurement system and method

ABSTRACT

A method and system for analysing and measuring multiple sources of data over a communications network ( 18 ) so as to ascertain information or usage of one or more resources, such as resource servers ( 2 ). A data collection and processing means ( 20 ) collects and processes the data sources which are forwarded to a reporting server ( 34 ) as a combined data source made available to interested parties.

CLAIM OF PRIORITY

This application is a continuation application of U.S. Ser. No.09/763,338, entitled “NETWORK RESOURCE MONITORING AND MEASUREMENT SYSTEMAND METHOD,” filed Sep. 5, 2003, which is a National Phase Entry ofPCT/AU00/00937, filed Aug. 7, 2000, which claims the benefit ofAustralian Application No. PQ2063, filed Aug. 6, 1999, which hereby areincorporated by reference in its entirety.

COPYRIGHT NOTICE

A portion of the disclosure of this patent document contains materialwhich is subject to copyright protection. The copyright owner has noobjection to the facsimile reproduction by anyone of the patent documentor the patent disclosure, as it appears in the Patent and TrademarkOffice patent files or records, but otherwise reserves all copyrightrights whatsoever.

TECHNICAL FIELD

The present invention relates to a system and method for measuringand/or analysing usage of resources. More particularly the presentinvention relates to measuring and/or analysing usage of resources on anetwork using data sources retrieved from actions performed by users ofthe resources, such measurement and/or analysis providing informationabout resources that do not have available statistics, (such as sitecentric measurements) and combining them with site centric data tocreate a more accurate whole of market picture or components thereof.

BACKGROUND ART

In the light of high penetration of Internet use and the rapid growth ofthe on-line industry, there has become a need for an accurate andindependent Internet site rating service. Such a service should provideon-line industry users and organisations and other interested partieswith a precise vehicle with which to assess vital Internet site trafficdynamics. For example, it would be advantageous for such users andorganisations to have an accurate picture of the information thatInternet users were viewing on and interacting with particular websites,as well as the range of sites that target markets were visiting, theadvertisements being viewed and how particular sites comparedstatistically with competitor sites. This type of commercial informationis invaluable to those in the on-line industry wishing to properlytarget their markets and also focus their on-line presence.

Furthermore, to date there has been no product or service for theon-line industry users and organisations that provides a total marketrating system that uses site centric measurements, such as proxy andserver log files, browser based measurements, and user centricmeasurements, such as panel data and sample survey data. Furthermore,site and user centric measurements have not been used to collect datarelating statistics pertaining to, for example, a website that has nosite centric measurement data available. By providing the sites withsuch information it provides a more accurate picture about the Internetpopulation and which sites the population use or visit regardless ofwhether the site centric measurements are available or not for aparticular site.

A syndicated multi media marketing data base has been used in Australiawhich integrates consumer demographics, product usage and mediaconsumption for value-added marketing and media solutions. The data baseenables advertising planners, buyers and users to target theiradvertising campaigns and to plan and evaluate integrated mediacampaigns based on the only official buying and selling currencies formainstream Australian media. The data base utilises the strengths of themedia industries most widely used research tools such as TV ratingsdata, radio ratings data, readership surveys and service usagequestionnaires. Each reporting period the operator of this data baseuses a combination of data to integrate TV viewing data, updated eachperiod, at the program level into a respondent single source data setwhich may comprise up to say 40,000 respondents. This method is used asa more integrated method of producing data sets capable ofcross-referencing television with other media and consumption variables.This approach allows viewing information from the audited televisionratings to be analysed against usage, consumption and other mediainformation. The television data base is refreshed periodically so thatthe most current television program data is available with ratingsconsistent with the operator of the data base.

The abovementioned system does not allow the “fusion” of one data sourcecreated from measuring interactions of a sample of users in relation totheir use of the resources, for example use of the internet, and afurther source of data pertaining to interactions provided by all usersof the resource, measured from for example a website, or viewers of aprogram measured by a television station to obtain accurate estimates oftraffic densities at for example a particular website or televisionprogram where the particular website or television station does not havethe further source available.

Known measurement techniques include that of a server log file analysis.In this method a log file is kept on the server of all record filesrequested, IP addresses of those visiting the site as well as successfuldownloading of all resources delivered from the site server. Thismethod, however is not necessarily an accurate indication of resourcesused and/or viewed on the site, due to the method not being able toaccount for resources that are subsequently stored in proxy servercaches or browser caches and are re-viewed. For example popular webpages may be stored on various Internet Service Providers (ISPs) proxyservers around the world, so that the ISPs do not need to directlyaccess a popular site every time a user requests access to that site.The ISP simply provides access to their stored version of the site. Thisenables the ISPs to provide a more efficient service, but results in aless accurate measurement service due to the inability to monitorcaches.

Similarly, once a site is accessed, site resources are saved in theuser's browser cache, while in use. While the server log file analysismay have recorded data relating to the accessed resources at the timethey were accessed, if the user then returns to one or more pages, suchas by hitting the “back” button on their browser, then the resourcebeing returned to is typically accessed from their browser cache, sothat once again this page request is not recorded by the server logfile.

Another method used by some organisations is the so-called browser basedmeasurement approach. In this method, software monitors site resourcesas they are viewed within a browser. This software monitors the user'sactions when accessing the Internet. While this approach does not sufferthe accuracy problems of server log file analysis, a problem that doesexist with this approach is that for a complete market analysis allsites need to be willing to agree to install the measurement code onevery site page. In practice, it has proven quite difficult to obtaincooperation with all sites.

In another method, also used by some organisations, Internet users arerecruited and their individual usage of the Internet is monitored to beused in statistical analysis. Usage is monitored by installing hardwareand/or software on the user's computer. This hardware or software is nottransparent for the user and is often quite onerous, requiring the userto log the software on each time they use it.

An example of this method is provided in U.S. Pat. No. 5,675,510, wherepersonal computer use is measured through the use of a hardware boxphysically located on the user's computer. This hardware records logfiles of Internet access by the user. This process is expensive due tothe hardware costs, installation costs and maintenance and supportcosts. Furthermore, the process is quite obtrusive, as the users arevery conscious of the tracking as they see the box every time they usetheir PC. Furthermore, the process does not track access of monitoredusers where for example, a monitored user accesses the internet at alocation other than at the user's home or work. Examples of locationthat are not monitored are cyber cafés, educational facilities, friend'shomes etc.

There is considered to be a need for an alternative measurement approachthat provides accurate results and also has improved transparency forthe user.

SUMMARY OF THE INVENTION

According to a first aspect of the invention there is provided a methodof measuring and analysing multiple data sources over a communicationsnetwork in order to ascertain information about the use of one or moreresources linked to said communications network, said method comprisingthe steps of:

obtaining a data source for a first group of one or more monitoredresources, said first group linked to said communications network;

obtaining a further data source for a second group of one or moremonitored resources or a group of monitored users, each of said secondgroup and said group of monitored users linked to said communicationsnetwork and

combining said data source and said further data source to form a singledata source available to interested parties so as to ascertain usageinformation on one or more resources.

The combining step may include one or more of displaying, aggregating,transforming, calibrating or formatting said single data source via areporting server means through said communications network.

According to a second aspect of the invention there is provided a systemfor measuring and analysing multiple data sources over a communicationsnetwork in order to ascertain information about the use of one or moreresources linked to said communications network, said system comprising:

a first group of one or more monitored resources, comprising resourceservers;

a second group of one or more monitored resources, comprising resourceservers,

a data collection and processing means for receiving a data source forsaid first group of one or more monitored resources, and for receiving afurther data source for said second group of one or more monitoredresources; and

reporting means for displaying said data source and said further datasource as a combined data source to interested parties so as toascertain usage information on one or more resources.

According to a third aspect of the invention there is provided a systemfor measuring and analysing multiple data sources over a communicationsnetwork in order to ascertain information about the use of one or moreresources linked to said communications network, said system comprising:

a first group of one or more monitored resources, comprising resourceservers;

a second group of one or more monitored users, comprising resourceservers;

a data collection and processing means for receiving a data source forsaid first group of one or more monitored resources, and for receiving afurther data source for said second group of one or more monitoredusers; and

reporting means for displaying said data source and said further datasource as a combined data source to interested parties so as toascertain usage information on one or more resources.

According to a fourth aspect of the invention there is provided anetwork enabling internet access by a user computer, characterised inthat a connection means on the user computer may be set to enableconnection between a proxy server and the user computer such that theproxy server is communicably coupled between the connection means on theuser computer and any internet site servers in order to monitor theinternet usage of the user.

In this regard, the expression “connection means” is taken to refer tothe means by which a user is provided with internet access, such as aninternet browser. Additionally, the user computer may be any meanscapable of receiving and displaying information from the internet, suchas a set-top internet terminal.

According to a fifth aspect of the invention, there is provided a methodof enabling research in a communications network having at least oneuser computer with an internet browser, the method comprising the stepof:

altering a proxy setting of the browser of the user's computer to divertthe user computer's internet access through a proxy server.

Therefore, by making a small change to the setting of a user'sconnection means/network browser at only one point in time, it ispossible to analyse the user's network usage, without the need forinstalling any software, impacting on user time or diverting theirattention. This method also is able to overcome the measurement problemspertaining to resources stored in caches.

According to a sixth aspect of the invention there is provided anapparatus for measuring usage of internet resources, comprising:

a proxy server in communicable relation with a user browser, thecommunicable relation effected via a proxy setting of the browser, suchthat the user browser is capable of accessing at least one internetresource via the proxy server, and the proxy server is capable ofinitiating usage measurement of the resource accessed.

According to a seventh aspect of the invention there is provided amethod of measuring usage of internet resources comprising the steps of:

enabling a user's browser proxy setting to reference the location of aproxy server;

receiving an internet resource request at the proxy server from theuser's browser;

forwarding the resource request to a resource server to obtain therequested resource;

receiving the requested resource at the proxy server from the resourceserver; and

passing the requested resource to the user's browser after the insertionof a measurement code to monitor the usage of the requested resource.

And finally according to an eighth aspect of the invention there isprovided a system for measuring and analysing multiple data sources overa communications network in order to ascertain information about the useof one or more resources linked to said communications network, saidsystem comprising:

a plurality of resource servers;

an insertion server linking each resource server of said plurality ofresource servers to said communications network;

such that when a request for a monitored resource from any one of saidresource servers is made, measurement code is inserted into saidrequested monitored resource by said insertion server for the purposesof measuring and analysing usage of the monitored resource.

BRIEF DESCRIPTION OF THE DRAWINGS

The invention will be hereinafter described in one or more preferredembodiments with reference to the accompanying drawings, wherein:

FIG. 1 is a schematic diagram of a system for measuring and analysingdata from data sources according to a first embodiment of the invention,particularly in relation to the use over the internet;

FIG. 2 is a schematic diagram of a system for measuring and analysingdata from data sources according to a second embodiment of theinvention, particularly in relation to accessing resources fromWAP-enabled user interface devices;

FIG. 3 is a schematic diagram of a system for measuring and analysingdata from data sources according to a third embodiment of the invention,particularly in relation to using a digital television network.

FIG. 4( a) is a schematic flow diagram showing the processes involved inmeasuring and obtaining various data sources generally in accordancewith the invention;

FIG. 4( b) is a schematic flow diagram showing the processes involved inmeasuring, obtaining and processing various data sources and applyingresults to extract data on unmonitored sources;

FIGS. 5( a) and 5(b) are block diagrams showing the processes involvedwith data when access is made to an unmonitored resource and a monitoredresource;

FIG. 6( a) is a schematic diagram of a system for measuring andanalysing data from data sources according to a further embodiment ofthe invention using a proxy server;

FIG. 6( b) is a schematic diagram of a system for measuring andanalysing data from data sources according to another embodiment usingan independent server; and

FIG. 7 is a schematic diagram showing the processes involved inaccessing a resource via a proxy server.

DETAILED DESCRIPTION

Shown in FIG. 1 is a system 1 used to measure and analyse data inaccordance with the present invention. Various users, having userinterface means 10, 12, 14 and 16, are linked to a communicationsnetwork 18 which also has links to various resource servers 2, 4, 6 and8 through which the users can access resources. There is generally aplurality of user interface means which may include but is not limitedto the following group: PCs, handheld devices such as mobile telephonesor palmtops, television receivers or monitors or any user interfacedevice capable or having information entered into, interacted with orviewed by the user. There may be a plurality of resource servers ofwhich 2 to 8 are examples. The communications network 18 may be theInternet or a digital or analog television network or anycircuit-switched or packet-switched network.

The embodiment shown in FIG. 1 will be described with particularreference to the Internet and the measurement and analysis of datasources from monitored resource servers, for example servers 2 and 4,unmonitored resource servers, say servers 6 and 8, and browsersinstalled on the user interface means. One data source is measured usingmonitored resources. This data source may comprise site centricmeasurements such as census data or audit data, proxy or server logfiles, implemented using Java, JavaScipt or CGI. The resources may beany one of a web page (to measure the number of accesses to the webpage), time spent on a web site or web page, page impressions or afeature of a web page or web site that is interacted with by one or moreusers or offers the option of a response to the users. Resource ownersagree to have their resources monitored to determine more informationabout the behaviour of users who access these resources. Measurementcode, a form of program code, is embedded in for example every web pageor embedded in each resource to be monitored. Every time a user accessesthe monitored resource the measurement code in the downloaded resourcerecords and collects information on that user and all such recordingsfor all users who access that resource are forwarded to a datacollection and processing means 20. Every page could physically havecode embedded therein or be dynamically inserted by another component,such as a separate server 130 (as shown in FIG. 6( b)), on its path tothe user. Specifically the data source from servers 2 and 4 is receivedby a first collection server means comprising one or more collectionservers 22, 24. The abovementioned data source is then forwarded to aprocessing server means 30 for processing, formatting, etc andthereafter stored in data storage means 35. The stored data may then beaccessed by a reporting server means 34 such that the data is displayedor manipulated in some manner when accessed by interested partiesthrough the network 18. All of the server means 22, 24, 26, 28, 30, 32,34 and 35 form part of a data collection and processing means 20 andeach of the tasks performed by these server means may be performed byone individual server or a group of servers. For example, the collectionservers and processing servers may be one and the same server.

With reference to FIG. 6( b) an insertion server 130 may be used toforward all requests between the resource servers 2, 4 and 6 and theusers 10, 12 and 14. Measurement code can be inserted by the insertionserver 130 into each monitored resource requested from a respectiveresource server.

A further data source may be measured and analysed from a group of oneor more monitored or participating users. A random sample of monitoredusers is recruited to form a panel from whom their interactions aremeasured and recorded in terms of accessing monitored and unmonitoredresources, at the resource servers, via each user's browser, indicatedby “B” in FIG. 1. The monitored users give their permission to allow themonitoring and tracking of their actions or interactions and providetheir personal details, such as where they live (region), sex, age,income, home or business user. Reliable statistics on Internetpopulation data collected is used to determine preset demographic quotasfor the recruitment process. These users should be demographicallyrepresentative of the preset quotas, according to such criteria as age,sex, income and whether or not the user is a business user or a privateuser.

The further data source may comprise user centric measurements includingpanel data, sample data, survey data. Each monitored user of the group(otherwise termed a “panellist”) will have every page impression, website access, or time spent on a site or page or any other characteristicmeasured and recorded via measurement code which is downloaded togetherwith the requested resource to the panellist's browser B. For example,then, if user interface means 10 and 12 are used by panellists each timethey access or interact with monitored resources, at servers 2 and 4,and/or on unmonitored resources through servers 6 and 8, these arerecorded by a second collection server means comprising one or morecollection servers 26, 28. Identification means is transmitted to thecollection servers 26, 28 identifying the user, after each interactionis recorded, either through some form of identification means orcookies.

Processing server means 30 and 32 respectively receive the data sourceand further data source to process the data. Thus processing server 32processes data forwarded to it from the second collection server means.Examples of processing include aggregating or formatting the data, orcalibrating the data for a particular purpose. One example of processingthe data sources includes calibrating them for a particular purpose,such as calculating an error rate to determine an estimate forinteractions, such as page impressions, for an unmonitored site forwhich there is no site centric data available. At this stage thereceived further data sources, as processed by the processing servers 30and 32 and subsequently stored in storage means 35, may be viewed ordisplayed by interested parties on reporting server 34. An example ofthe calibration process will hereinafter be described.

It is to be noted that the further data source may be of the same typeas the first mentioned data source, that is, from monitored resources.

Weighting may be performed to the collected data source and further datasource in each of the collection servers 22 to 28. This is performed bythe processing servers 30 and 32. The weighting is done to adjust forthe difference in demographic profiles of the sample or group to thepopulation. The population weightings are obtained from pre-establishedinternet population statistics for a certain time period. This stepensures that the collected data, after the weighting process, isrepresentative of the Internet population of the measured geographicalregion. To derive greater accuracy a further breakdown of the officialdata showing the Internet population statistics may be performed into acombination of various groups or subjects. Such groups may include sex,age, current access method, income. Thus the collected data from pageimpressions from the sample users may be tabled in terms of each of thecategories mentioned above to provide a more accurate picture tointerested groups. Furthermore, the breakdown may be in terms ofcategories relating to the types of monitored resources, for example,sport, politics, entertainment, business.

There will be an overlap of the data source and further data sourceresults where a monitored resource, having say site centric measurementsavailable, has corresponding further data source results pertaining topanellists. Thus, for example, for a monitored web site there is paneldata collected from each of the panellists for the same monitored website. Comparable data is therefore taken from the two correspondingdifferent sources, being panel data which may pertain to variousinteractions performed by the panellists, and the abovementioned sitecentric measurements.

If, for example a panel or group of 3000 users are registered from whichpanel data is obtained, then a weighting function is applied todetermine or estimate actual traffic levels for all internet users in aparticular region. For example in Australia, there is an estimated totalinternet audience of 4.4 million. Weighting is simply applied as amultiplication factor which brings the representative sample in linewith the total traffic market trends, that is, 4,400,000/3000=1466.7.All unique visitor numbers for sites or page impressions are multipliedor weighted by this factor in order to estimate the actual trafficlevels.

Of the 3000 users who are taking part in the panel, say 2000 users,visit a monitored web site (resource) from server 2 or performparticular interactions on that web site which has corresponding sitecentric measurements output available, and another 2500 panellists visita web site that is not monitored, say at server 8. As the other web siteis not monitored then there is no site centric measurement dataavailable and so to estimate the total traffic or users that wouldaccess the other web site or perform particular interactions on that website or on a web page of that web site, the following occurs.

The 2000 users who have accessed the web site that is monitored, atserver 2 is scaled up in accordance with the internet. Thus, we arriveat a figure of the total number of the internet audience being4,400,000, divided by the number of panellists taking part in thesample, being 3000, and multiply this by 2000, which represents thenumber of panellists estimated to have actually visited that site. Thisresults in an expected 2,933,333.3 users in the internet population tovisit this site over the predefined period. This is the ideal situationwhere we would expect the numbers obtained, after scaling up, and theactual site centric measurements to correspond exactly. Equivalently,the number of users in the internet audience you would expect to visitthe unmonitored site, at server 8 is 4,400,000/3000×2500=3,666,666.6visits.

However, inherent in the sampling there are expected to be deviationsand therefore calibration in terms of an error rate is introduced, beingthe ratio of the site centric measurements to that of the equivalentpanellist metrics. Separate metrics may be used to improve accuracy,such as one for page impressions, advertisement views, unique visitors,or other traffic measurements or other resource metrics. Each of theerror rates are derived for the metrics for the particular period underreview.

Thus, for the above example, if the actual census data for the number ofvisits to the monitored web site is 3,200,000, then the actual deviationis 3,200,000/2,933,333.3 which provides a ratio of 1.0909 so that thesample has an error rate of a factor of 0.0909. This ratio of 1.0909 isthen multiplied by the derived figure above (3,666,666.6) for the sitethat is not monitored which is equivalent to 4,000,000 visits or use ofthe attributes.

The above derived example related to using only one monitored site.However, similar or other techniques can be applied on a group ofresources, such a number of web sites or advertising page impressions.Furthermore different metrics, based on different requirements may needalternative calibrations, such metrics including page impressions,unique visitors or time measurement. The calibration may be based on twodata sources or more than two data sources, whether they be frommonitored or unmonitored resources.

Thus, by using the above method, sites that are not monitored can haveadditional data available to them to estimate the amount of trafficwhich provides an invaluable resource to interested parties tospecifically target users in respect of various activities orinteractions that they have undergone in accessing a particular website. Furthermore, it provides additional information to owners ofmonitored web sites as to how many visits or interactions/responsesunmonitored web sites (being potential competitors to such owners) havehad from the internet audience, based on the two or more sources ofdata, from the site centric measurements and/or from the user centricmeasurements, or simply based on the site centric measurements. Thusmore information is available about the behaviour of the internetpopulation or audience.

In the abovementioned process, in order to produce comparable data,sites having site centric data collected are grouped into the samegrouping of sites which is made in the user centric data. Thereafter,the same groupings of URLs in the site centric and user centric groupsare then formed. Naturally, the bigger this group accounts for in termsof the number of monitored resources or page impressions for example,the more accurate the end results are expected to be.

With reference to FIG. 2, various users may have user interface meansthat are for example WAP-enabled processors such as a mobile telephone40, linked to a cellular network 46 which in turn is linked to theinternet 18 through a WAP gateway 48. Each of the WAP-enabled devicesuse the Wireless Mark-up Language (WML). Accesses to or interactionswith a monitored resource are recorded by embedding measurement code inthe monitored resource and this is forwarded to collection servers 22,24 of the data collection and processing means 20 as in the previousexample. Those users forming part of a panel or group have correspondinginteractions monitored whereby measurement code, as mentioned earlier,is downloaded with the requested resource(s) into the WAP-enableddevices to monitor the actions or interactions of each of the users ofthe devices. Each of the interactions of the users are monitored andrecorded by the measurement code for corresponding interactions onmonitored and unmonitored resources and forwarded to collection servers26, 28 of the data collection and processing means 20. Information inthe form of reports may be displayed to interested parties aftercombining the two separate sources of data, as processed by processingservers 30 and 32, on reporting server 34. Again, this follows theforwarding of the processed data from the processing servers 30, 32 todata storage means 35 which is accessed by the reporting server 34. Ofparticular interest, information about interactions of the various usersfor sites that are not monitored is available by previously mentionedcalibration techniques.

The above principles are easily adapted to Web television, whereby eachof the devices 10, 12, 14 or 16 are television receivers such that usersare monitored in terms of their responses or choices of optionsregarding a particular television program or television commercial. Thusthere are a number of sample TV users having respective televisionreceivers accessing the internet and are monitored in terms of theirresponses or interactions on a particular resource server by theabovementioned measurement code accompanying each of the resources beingdownloaded to each of the users' devices. For various resources the sitecentric measurement data is already available and there will be someresources that overlap with the recorded user centric data. Thusinformation pertaining to various interactions or actions by many usersare obtainable for other sites that are not monitored which therebyprovides a good comparison of resource usage, for example, of variousweb sites to interested parties.

With reference to FIG. 3, there is shown a digital television network 50to which are linked various television receivers 10. 12 and 14 that haveusers who have agreed to be part of a survey for monitoring theirresponses or actions for a particular resource such as a televisionprogram or commercial. There are also other users 54 who have digitaltelevision receivers for which no monitoring is conducted. A televisionstation resource server 2 will transmit various programs oradvertisements over the digital network 50 and for some programs willalready have site centric measurement data, such as audit or census dataavailable on all of the users (users on receivers 10, 12, 14 and 54) whoview the program and make responses or actions where required regardingthat program or advertisement. Again, a sample of users is used toobtain panel data by measurement means to each of the sample userreceivers 10, 12 and 14 that can track their movements and actions inrelation to other unmonitored corresponding advertisements or otherunmonitored programs from different television networks, such as TVstation resource servers 4 and 6, as well as the monitored programs fromTV station resource server 2. All this information can be used tocalibrate or check panel data for which interested parties such as usersin the on-line industry or those in the television industry can receivereports through reporting server 34 on popular programs that are watchedor advertisements that are responded to across the whole digitaltelevision user population. The abovementioned error rate is alsoapplicable in determining numbers of users who respond to or interact inother ways with resources that are not monitored. The data collectionand processing means 20 includes the first and second collection servermeans 22 to 28, processing servers 30 and 32, data storage means 35 andreporting server 34 to undertake similar tasks as mentioned with respectto the embodiments described in FIGS. 1 and 2. Each of the collectionservers and processing servers and the storage means 35 and reportingserver 34 may be separate servers or function as one server unit. Thedata collection and processing means 20 may form part of a televisionstation for calculating and collecting the data and the calibrationapplicable to unmonitored resources, such as other programs.

The medium in which the two data sources are obtained need not be thesame. For example site centric measurement data may be obtained forinternet based resources and be compared with or correlated with usercentric measurement data for Web TV users or digital television users.

With reference to FIG. 4( a), there is shown a number of steps used bythe method and system of this invention in respect of any medium andresources thereof. Firstly, at step 60, a resource such as a web site orweb page or television program, is monitored to determine and record allinteractions with or accesses with the resource by all users havingaccess to the resource.

A data source, such as site centric data, is obtained for one or moreinteractions at step 62 from all users who interact in some way with themonitored resource. This is recorded and collected by the collectionservers 22, 24 of the data collection and processing means 20. By way ofexample, the number of visits to a particular web page has may berecorded.

After establishing a panel or group of users, at step 64 these users aremonitored for their interactions and at step 66 a second data source,such as panel data or any other form of data, is measured, recorded andcollected by collection servers 26,28 of the data collection andprocessing means 20. The panel data may comprise for example pageimpressions or the number of visits each panellist has for the monitoredresource, such as a web site and every unmonitored resource. At step 68,the two sets of data sources may be viewed, combined or otherwisecustomised on server 34.

In FIG. 4( a) two or more data sources may be used for analysis, whetherthey originate from the same type of source, for example, monitoredresources, or from different types of sources, for example, one or moremonitored resources and/or one or more unmonitored resources frommonitored users.

In FIG. 4( b), at step 70 resources are monitored, such as a web siteaccess or page impression by all users and at step 72 a data sourcerelating to site centric measurements is obtained for such web siteaccesses or page impressions. At step 74, pre-selected users aremonitored for their interactions, corresponding to the monitoredresource, for example the same web site accesses or page impressions andequivalently those same interactions of an unmonitored resource orresources. At step 76, the further data source relating to the aboveuser centric measurements is obtained and forwarded to the collectionservers 26, 28. Collection servers 22, 24 will have the data from step72. Processing servers 30, 32 calculate or calibrate an error rate basedon the two sets of data at step 78 after scaling up has taken place andthen at step 80 the error rate is applied to the unmonitored resource(s)from steps 74 and 76. Reports on the results may be displayed on server34 for access by users in the on-line industry after the processed datahas been transferred to the storage means 35 from the processing servers30, 32.

In FIG. 5( a) there is shown processes used when a user's browserrequests a monitored resource. The browser 80 first of all sends arequest (81) for a monitored resource from resource server 82. Theresource is sent back (83) from the server 82 to the browser 80 withmeasurement code which was originally embedded. The measurement codemonitors and collects information on the usage of the resource by theuser and at (84) a record of this is sent to the respective collectionserver(s) 85. Thereafter the record can be processed together with otheruser or site centric measurements by the respective processing server(s)87. Where the user is a panellist, the measurement code would alreadyhave been sent to the panellist's browser and the interactionsassociated with a monitored or unmonitored resource recorded and sent tothe respective collection server(s) 85. Thereafter it is processed byprocessing server(s) 87 and forwarded for storage to the data storagemeans 88. Reports may then be generated from the data storage means 88to the reporting server 89.

In FIG. 5( b) there is shown process steps when a panellist requests anunmonitored resource. The user's browser 80 makes a request (91) for theunmonitored resource at the resource server 90 through the proxy server100 which returns (92) the request to the browser 80 via the proxyserver 100. The proxy server 100 inserts the measurement code into therequested resource before forwarding the request to the browser 80. Thenthe measurement code monitors and collects information on the usage ofthe unmonitored resource and forwards this at (93) to the collectionserver(s) 85, which is then collated as user centric measurement data.It may then be processed by processing server 87 and forwarded on toreporting server 89 via the storage means 88 as previously described. Itis to be noted that the collection server(s) 85 may also be one and thesame server as the proxy server 100.

Rather than obtaining measurements through browsers, or equivalentlysome program means loaded onto a user interface device, specificsoftware may be loaded onto the devices 10, 12, 14 or a “hardware” boxmay be attached to the devices so that the user may be aware that he orshe is being monitored. Alternatively, a proxy server may be used.

Where a proxy server is used, it is invisible to the user and enables anorganisation or interested parties to monitor the internet usage of thepanel member as an alternative to installing software or firmware ontothe panel member's user interface. An advantage of the transparency ofthis tracking technique is that it promotes panel continuity.

In accordance with a further embodiment and with reference to FIG. 6(a), resource requests and responses between user interface devices 10,12 and 14 and the resource servers 2, 4 and 6 go through a proxy server100. The proxy server may form part of the data collection andprocessing means 20.

Once a user has agreed to become a panel member, the user is instructedto change his or her browser setting to access the internet via theproxy server 100. If the user has trouble in effecting this set-up, theymay e-mail a helpdesk provided by the organisation or access a callcentre via telephone.

Examples of the manual proxy set-up process will now be described withreference to some existing Internet browsers.

If the user has Internet Explorer 4.0 or 5.0, to divert their internetaccess through a proxy server, they would be required to select“Internet Options” from their “View” menu, then “Connection Folder”,followed by “Access the Internet using a proxy server”. In the addressentry box, they would enter the address of the proxy server, which wouldbe provided to them by the research organisation.

Alternatively, if the user had Netscape 4.0, they would be required toselect “Preferences” in the “Edit” menu of their browser, followed by“Advanced”, “Proxies”, “Manual Proxy Configuration” and “View”. In thehttp: entry box they would then be required to enter the address of theproxy server, as provided by the party initiating the networkmeasurement.

As an alternative to the manual set-up process, a software program maybe used to effect the browser setting change: for example, the usercould click on a link, and the link would then implement the change.

With reference to FIG. 7, when a user requests a resource on theirbrowser 110, the request first goes (112) to the proxy server 100. Therequest is then forwarded (114) by the proxy server 100 to thecorresponding resource server 116. The resource server passes (118) therequested resource to the proxy server 100 and from there (120) themeasurement code is embedded in the requested resource, at the proxyserver 100 before it goes back to the user's browser 110 to record theinteractions of the user. A record of this request is then sent (122) tothe collection server of the data collection and processing means 20 forprocessing as part of the data source, where site centric measurementsare collected for this particular user and other users in respect ofsimilar resource requests. If the data relates to the further datasource whether monitored or unmonitored, for example panel data of apanellist, like user centric measurements, then this procedure isrepeated but the data is collected by the respective collection server26, 28. It is to be noted that the collection servers 22 to 28 and theproxy server 100 may be the same server.

Thus, for some monitored resources there will be an overlap of site anduser centric measurements for which data may be displayed separately orcombined on reporting server 34. Alternatively an estimate of trafficdata can be determined for those unmonitored resources having no sitecentric measurements available, using the aforementioned techniques.

When the access request is diverted to the proxy server 100, the panelmember is able to be identified by virtue of an identification meanssuch as user ID or a unique cookie assigned to the member during thesign up process. A cookie is a feature of the internet protocolHypertext Transfer Protocol (HTTP), which is essentially a uniqueidentifier stored on the user's computer.

During the processing of the data it is possible to check for anyanomalous usage of sites (eg. One user visiting a particular site fiftytimes in one day), that may not be representative of the overall sampleof panellists. If it finds anomalies like this, the particular data maythen be disregarded.

When recording interactions of a panel of users at the data collectionand processing means 20, a view of internet usage by the “panelpopulation” is able to be obtained. The data obtained via this panelapproach may be used in isolation to obtain relevant statistics.Alternatively, as previously mentioned, a fusion of the panel data withsite centric measurement data such as from browser based data or proxyor server logs may be used. In this alternative way, it is possible tofill the reporting properties or interactions of resources for whichaccurate site centric measurement data is not available, in order toimprove the overall market measurement accuracy.

The user details should be periodically validated, so from time to timethe users should be contacted to confirm participation and verifypersonal details.

Variations and additions are possible within the general inventiveconcept as will be apparent to those skilled in the art. In particular,if a user's browser or interface device does not support Java,alternative approaches for obtaining measurement data are possible andwithin the inventive concept, such as via CGI (Common Gateway Interface)measurement.

1. A method of measuring and analysing multiple data sources over a communications network in order to ascertain information about use of one or more resources linked to said communications network, said method comprising the steps of: obtaining a data source for a first group of one or more monitored resources, said first group being linked to said communications network; obtaining a further data source for a second group of one or more monitored resources, each of said second group and said first group linked to said communications network, when said further data source is obtained with respect to a group of monitored users, initially forming a first group of monitored users as a sample group so as to record and measure interactions of users in the sample group; and combining said data source and said further data source to form a single data source available to interested parties so as to ascertain usage information on one or more resources; processing the data source and the further data source, wherein the processing of the further data source is in relation to the interactions of the users in the sample group;_and calibrating a value based on said data source and said further data source.
 2. The method according to claim 1 comprising the step of, wherein said further data source is obtained with respect to said group of monitored users, initially forming said first group of monitored users as a sample group so as to record and measure interactions of users in said sample group.
 3. The method according to claim 2 wherein the further data source is based on said interactions in relation to one or more resources.
 4. The method according to claim 3 further comprising the step of processing said data source and said further data source, and wherein the processing of said further data source is in relation to the interactions of the users in said sample group and further comprises calibrating a value base on said data source and said further data source.
 5. The method according to claim 4 wherein said calibrating comprises calculating an error rate.
 6. The method according to claim 5, wherein the further data source is based on interactions in relation to one or more unmonitored resources, and further comprising the step of applying the error rate to the further data source so as to determine an estimate of equivalent interactions of total users with respect to the one or more unmonitored resources.
 7. The method according to claim 6 further comprising the step of calculating a weighting factor based on a number of users in said sample group and a total number of users expected to have access to one or more resources available through said communications network.
 8. A system for measuring and analysing multiple data sources over a communications network in order to ascertain information about use of one or more resources linked to said communications network, said system comprising: a first group of one or more monitored resources, comprising resource servers; a second group of one or more monitored resources, comprising resource servers; a data collection and processing means for receiving a data source for said first group of one or more monitored resources, and for receiving a further data source for said second group of one or more monitored resources, wherein the further data source and the data source collected by a collection server means are processed by a processing server means in the data collection and processing means to calibrate a value based on the data source and the further data source; and reporting means for displaying said data source and said further data source as a combined data source to interested parties so as to ascertain usage information on one or more resources.
 9. A system for measuring and analysing multiple data sources over a communications network in order to ascertain information about use of one or more resources linked to said communications network, said system comprising: a first group of one or more monitored resources, comprising resource servers; a second group of one or more monitored users; a data collection and processing means for receiving a data source for said first group of one or more monitored resources, and for receiving a further data source for said second group of one or more monitored users, wherein the further data source and the data source collected by the collection server means are processed by a processing server means in the data collection and processing means to calibrate a value based on the data source and the further data source; and reporting means for displaying said data source and said further data source as a combined data source to interested parties so as to ascertain usage information on one or more resources.
 10. The system according to claim 8 wherein said data collection and processing means includes collection server means for collecting said data source and said further data source and further includes processing means for processing the data source and the further data source collected by the collection server means.
 11. The system according to claim 9 wherein in relation to said further data source for said second group, interactions and resource requests of each of the monitored users of said second group, entered on respective user interface means, are measured and recorded and sent to collection server means in said data collection and processing means.
 12. The system according to claim 11 wherein the further data source is based on interactions from said monitored users of said second group in relation to one or more resources.
 13. The system according to claim 12 wherein said further data source and said data source collected by said collection server means are processed by processing server means in said data collection and processing means to calibrate a value based on said data source and said further data source.
 14. The system according to claim 13, wherein the further data source is based on interactions from said monitored users in relation to one or more unmonitored resources, and wherein the value is an error rate which is subsequently applied to the further data source so as to determine an estimate of equivalent interactions of total users with respect to the one or more umnonitored resources.
 15. The system according to claim 14 wherein said processing server means calculates a weighting factor based on a number of users in the second group of one or more monitored users and a total number of users expected to have access to one or more resources available through said communications network.
 16. A method according to any one of claim 1 wherein said communications network is the Internet.
 17. A system according to claims 8 wherein an insertion server means is used to insert measurement code into each resource requested by a user.
 18. A system for measuring and analysing multiple data sources over a communications network in order to ascertain information about use of one or more resources linked to said communications network, said system comprising: a plurality of resource servers; and an insertion server linking each resource server of said plurality of resource servers to said communications network, such that when a request for a monitored resource from a resource server of said plurality of resource servers is made, measurement code is inserted into said monitored resource by said insertion server for purposes of measuring and analysing usage of the monitored resource. 